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Image display apparatus 



The invention relates to an image display apparatus comprising: 

- means for receiving a video stream representing a series of consecutive input 

images, with the series of consecutive input images comprising a first image and a second 

image; and 

S - a display device for displaying a series of consecutive output images which 

are based on the series of consecutive input images. 

The invention further relates to a method of displaying a series of consecutive 
output images which are based on a series of consecutive input images, with the series of 
consecutive input images comprising a first image and a second image. 
10 The invention further relates to a TV comprising such an image display 

apparatus. 

In video broadcasting, subtitles are employed to convey textual information to 
the viewer. The subtitles accompany an audio/video broadcast and provide supplemental 
information to the viewer that may not be perceivable from the broadcast. Subtitles ate 

1 5 frequently used, for example, to aid hearing impaired viewers by displaying the spoken 
language recorded in the audio soundtrack as written language. Another example, is where 
subtitles are displayed in different languages than the spoken language recorded in the audio 
soundtrack* In addition, subtitles may be employed to convey important information not 
related to the subject matter of the corresponding audio/video broadcast. In this case, subtitles 

20 may represent late-breaking news, such as: emergency intbnnationj sports scores, weather 
reports or information of the stock exchange. Frequently the information is provided by 
means of a banner. The textual information moves relative to the display screen of the display 
apparatus. Typically the direction of the movement is in a horizontal or vertical direction. 

In television broadcasting or video reproduction, such as from a video tape or 

25 disk, the subtitles or banners are previously superimposed on the broadcast and become part 
of the received images. Hence the display of the information of the subtitles or banners is 
linked with the display of the other video content It is a disadvantage that in many cases the 
provided textual information of the subtitles or the banner is only visible for a limited period 
of time. 
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It is an object of the invention to provide an image display apparatus of the 

kind described in the opening paragraph on which a spatial part of a received series of input 

images is visible for a relatively long period. 

The object of the invention is achieved in that the image display apparatus is 

5 arranged: 

- to split the consecutive input images into respective first parts and respective 
second parts; and 

- to display a fhst one of the output images comprising a first block of pixels 
corresponding to the first part of the firstinput image and a second block of pixels 

10 corresponding to the second part of the second input image. 

Ifftatheroulpui^ 

input image then it can be seen as if the coiresponding part of the display device is frozen. 
The other part of the display device is updated on a regular base with consecutive second 
parts. Note that it is known to fteeze the entire display device. However in this case only a 

1 5 part of the display device is frozen while the other part is not The invention is advantageous 
in the case that the first parts of the received input images correspond to respective portions 
of a banner: it can be seen as if the movement of the banner is stopped- By doing this the 
readability of the banner is enhanced. The invention is also advantageous in the case that the 
first parts of the received input images correspond to subtitles, By freezing the corresponding 

20 part of the display device, the user of the image display apparatus has more time to read, or 
reread the subtitle. 

An embodiment of the image display apparatus according to the invention 
comprises user interface means to provide location information of the first parts to control 
splitting of the images of the series of consecutive input images. It is assumed that in a 

25 default display mode of the image display apparatus the entire display device is updated on a 
regular base. However if the received input images comprise distinct parts then it is 
advantageously to split the images in first parts and second parts and to control the display of 
the first parte independently of the second parts. Location information of the first parts 
relative to the second parts is required in order to split the received input images. A first 

30 option is that the user of the image display apparatus provides this information. E.g. by 

dragging a graphics box or by manipulation of a graphics line being displayed on the display 
device as a kind of overlay. Automatic segmentation of the input images is another option to 
detennhie the location infonnation. Motion estimation is a good basis for this segmentation. 
Alternatively the location information is provided by means of the broadcast, 
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An embodiment of the image display apparatus according to the invention 
comprises a first memory device for storage of the location information. The location 
information is relatively constant By storing the location information it is no longer required 
to determine or provide the location information again. Optionally multiple instances of the 
5 location information are stored as a presetting for the various broadcasting channels. In that 
case a user of the image display apparatus might start the required display mode, i.e, partially 
frozen display mode, with one push of a button of the remote control. Optionally the image 
display apparatus automatically switches from a default display mode in which the entire 
display device is updated on a regular base into the partially frozen display mode. This 
10 switching might be triggered by a "banner-event", i.e. the presence of a banner is detected. 

An embodiment of the image display apparatus according to the invention 

comprises: 

- a motion estimation unit for estimating motion in the first parts; 

- processing means to calculate a time period during which a particular part of 
15 the banner moves from a first predetermined location relative to the display device to a 

second predetermined location relative to the display device; and 

- a selector to select a further one of the first parts of a farther input image, on 
basis of tile time period. 

An advantageous of this embodiment of the image display apparatus is that it 
20 is arranged to remove redundancy in the first parts. First parts of consecutive input images 
comprise portions which are also comprised by other first parts of the consecutive input 
images. This embodiment of the image display apparatus is arranged to create a set of first 
parts of the input images, of which the elements of the set have a m in im um of overlap with 
each other, but which together comprise a maximum of the information conveyed by the 
25 banner. The elements of the set might be displayed automatically or on basis of a user input. 
Optionally these first parts are stored in a second memory device. This enables browsing 
through the set of first parts. 

An embodiment of the image display apparatus according to the invention 

comprises: 

30 - a character analyzer designed to search for textual infonnation in the first 

parts; and 

- a comparing unit for comparing parts of the textual information with a 
predetermined string of characters. 
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This embodiment of the image display apparatus is arranged to search for 
specific textual information in the first parts conveyed by a banner or subtitle. When this 
textual information is detected then one of the first parts comprising this textual information 
is displayed on the display device. An example of such a character analyzer is specified in 
5 US 6,195,459, 

It is a further object of the invention to provide a method of the land described 
in the opening paragraph with which a spatial part of a received series of input images is 
visible for a relatively long period. 

This object of the invention is achieved in that the method comprises; 
10 - a splitting step of splitting the consecutive input images into respective first 

parts-and-respectdve- second- partsj-and 

- a display step of displaying a first one of the output images comprising a first 
block of pixels corresponding to the first part of the first input image and a second block of 
pixels corresponding to the second part of the second input image, 
1 5 Modifications of the image display apparatus and variations thereof may 

correspond to modifications and variations thereof of the method described. 

These and other aspects of the image display apparatus, of the TV and of the 
20 method according to the invention vrill become apparent from and will be elucidated with 
respect to the implementations and embodiments described hereinafter and with reference to 
the accompanying drawings, wherein; 

Fig- 1 schematically shows a series of input images and a series of output 
images according to the invention; 
25 Fig. 2 schematically shows an embodiment of the user interfere for the control 

of the splitting; 

Fig. 3 schematically shows the relation between a banner and a series of 
consecutive input images; 

Fig. 4 schematically shows an embodiment of the image display apparatus; 
30 Fig. 5A shows a data-flow diagram; and 

Fig. 5B shows an alternative data-flow diagram. 
Corresponding reference numerals have same or like meaning in all of the Figs. 
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Fig. I schematically shows a series 100 of input images 104-108 and a series 
102 of output images 1 10-1 14 according to the invention. The images 104-1 14 represent a 
portion of a sport game. Besides that* textual information is provided in the lower parts 128- 
138 of the images 104-114, The parts 1 16-126 of the images representing the portion of the 
5 sport game do not overlap with the lower parts 128-13 8 of the images. A first one 1 14 of the 
consecutive output images 1 10-1 14 comprises a first part 138 which corresponds to a first 
block of connected pixels 132 of a first one 108 of the series of consecutive input images 
104-108, and a second part 126 which corresponds to a second block of connected pixels 120 
of the first one 108 of the series of consecutive input images 104-108, A second one 1 12 of 
10 the consecutive output images 110-114 comprises a first part 136 which also corresponds to a 
first block of connected pixels 1 32 of the first one 108 of the series of consecutive input 
images 104-108, and a second part 124 which corresponds to a second block of connected 
pixels 118 of asecond one 106 of the series of consecutive input images 104-108. A third one 
1 10 of the consecutive output images 1 1 0-1 14 comprises a first part 134 which also 
15 corresponds to a first block of connected pixels 132 of the first one 108 of the series of 

consecutive input images 104-108, and a second part 122 which corresponds to a third block 
of connected pixels 1 16 of a third one 104 of the series of consecutive input images 104-108. 
Hence, the output images 1 1 0-1 14 comprise blocks of pixels 134-138 which correspond to 
the same first part 132 of one 108 of the input images 104-108. 
20 Fig, 2 schematically shows an embodiment of the user interface for the control 

of the splitting between a first part 13 8 and a second part 126 of the output image 1 14. On the 
display device 406 a graphics line 200 is drawn as an overlay of the output image 114. The 
user of fee image display apparatus 400 can adapt the position of the line by means of 
pushing a plus or minus button of the remote control of the image display apparatus 400. 
25 Such manipulation of the display can be achieved using the fecilities of the OSD (On Screen 
Display) features of the display apparatus 400 and or other graphics features of the display 
apparatus 400. The position of the line 200, corresponds to the location information which is 
required to split the images 104-108 of the series 100 of input images in first parts 128-132 
and second parts 1 16-120. Optionally the position of the line 200 is stored in a memory 
30 device. Preferably multiple instances are stored, e.g. a first position for channel 1, a second 
position for channel 2, etcetera. 

Fig. 3 schematically shows the relation between a banner 300 and a series 100 
of consecutive input images 104-108, A banner 300 can be seen as a strip of information 
which moves relative to the display device 406. In a default display mode of the image 
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display apparatus on which a banner 300 is displayed the output images comprise 
overlapping parts ofthe banner 300. E.g. a first image comprises a first portion 302 of the 
baimer 300, a second image comprises a second portion 304 ofthe banner 300, a third image 
comprises a third portion 306 ofthe banner 300, etcetera. These portions 302-320 partly 
5 overlap with each other. However there are pairs of portions which do not have overlap e.g. 
first portion 3 02 and fifth portion 3 1 0. It can be seen from Fig. 3 that with a combination of 
non-overlapping portions, e.g. 302, 310, 312 and 320 the entire banner 300 can be 
represented. By selecting the appropriate images ofthe series of input images a set of first 
parts of the input images can be created, of which the elements of the set have aminimumof 
10 overlap with each other, but which together comprise a maximum of the information 
CQBvey ^y_lfae.baimflrA0.Q.i^tio^y.^J^ are stored_ina_memp^^oeS06\S^ 



Pig. 5B. 

An approach of finding these first parts is based on estimating motion. Motion 
estimation can be performed by a standard motion estimation unit. A standard motion 

15 estimation unit might be the motion estimation unit which is known ftom the article "True- 
Motion Estimation with 3-D Becursive Search Block Matching" by Q. de Haan et. at in 
IEEE Transactions on circuits and systems for video technology, vol.3, no.S, October 1993, 
pages 368-379. The motion estimation unit provides amotion vector field. This motion 
vector field has to be analyzed, on basis of a motion model of constant translation to 

20 determined the velocity ofthe banner. The velocity ofthe banner determines the overlap 

between parts of consecutive images. With knowledge of the dimension of the display areaof 
the banner 300 the number of images to be skipped can be calculated. As a consequence only 
the first parts ftom one out of N images have to be dealt with, e.g. stored or displayed. 

Pig. 4 schematically shows an embodiment ofthe image display apparatus 400 

25 comprising: 

- receiving means 402 for receiving a signal representing input images 104- 
108 to be processed. The signal may be a broadcast signal received via an antenna or cable 
but may also be a signal ftom a storage device like a VCR (Video Cassette Recorder) or 
Digital Versatile Disk (DVD), The signal is provided at the input connector 408. The 

30 receiving means 402 is arranged to be tuned to a predetermined frequency band to extract the 
input images 104-108 ftom the provided signal 

- processing means 404 for making the output images 1 10-1 14 on basis ofthe 
input images 104-108; The processing means comprises memory devices 500 and 506, 
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- display means for displaying the output images 110-1 14- This display means 
is optional. The fimctionality can also deployed by making use of a e.g. Set-top box. In that 
case the displaying is done by a Television and other parts of the processing by means the 
Set-top box. 

5 Fig, 5A shows a data-flow diagram. In Fig. 5A a memory device 500 is 

depicted which is logically divided in a first part 504 in which first parts 128-1 32 of input 
images 104-108 are written 508 and a second part 502 in which second parts 1 16-120 are 
written 506. To display an output image 1 10-1 14 the memory device is accessed for reading 
512 the appropriate first 134-138 and for reading 510 the second parts 122-126. In default 

10 display mode of the image display apparatus 400 the frequency of reading 5 12 first parts 134- 
138 and of reading 510 second parte 122-126 for the output images 1 10-1 14 is equal with 
writing 508 first parts 128-132 and writing 506 second parts 1 16-120. However In the 
partially frozen display mode of the image display apparatus 400 the frequency of writing 
508 first parts 128-132 is zero, Le. no updates of the portion 504 of the memory device 500 

15 for storing first parte 128-132. Hence the stored first part 132 is repeatedly read. Note that in 
principle there is no need for storing second parte 1 16-120 because these arc directly 
displayed. The required memory size depends on the first parts 128-132 only. 

Fig. SB shows an alternative data-flow diagram* A second memory device 516 
is available for storage of multiple first parts corresponding to non-overlapping portions 302, 

20 3 10, 3 12 and 320 of a banner 300- One of the first parts is selected and written 5 14 to the first 
part 504 of the other memory device 500, The selection can be based on a direct user control: 
next first part Alternatively the selection is based on a match of textual information 
comprised by the selected first part and a predetermined character string. 

It should be noted that the above-mentioned embodiments illustrate rather than 

25 limit the invention and that those skilled in the art will be able to design alternative 

embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be constructed as limiting the claim. 
The word 'comprising' does not exclude the presence of elements or steps not listed in a 
claim. The word "a" or "an" preceding an element does not exclude the presence of a 

30 plurality of such elements. The invention can be implemented by means of hardware 

comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. 
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CLAIMS: 



1 . An image display apparatus (400) comprising: 

- means (402) for receiving a video stream representing a series (100) of 
consecutive input images (104-108), with the series (100) of conseoutive input images 
comprising a first image (108) and a second image (106); and 

- a display device (406) for displaying a series (102) of consecutive output 
images (110-114) which are based on hie series (100) of consecutive input images (104-108), 
"chatac^^m"mattiMlmage display apparaws (400) is arranged!" 

- to split tlie consecutive input images into respective first parts (128-132) and 

respective second parts (1 16-120); and 

-to display a first one (112) of the output images (110-114) comprising a first 
block of pixels (136) corresponding to 1he first part (132) of the first input image (108) and a 
second block of pixels (124) corresponding to the second part (118) of the second input 
image (106). 

2, An image display apparatus (400) as claimed in Claim 1, characterized in that 
tiie first parts (128-132) correspond to respective portions of a banner (300). 

3. An image display apparatus (400) as claimed in Claim 1, characterized in that 
the first parts correspond to a subtitle. 

4, An image display apparatus (400) as claimed in Claim 1, characterized in 
comprising user intermce means (200) to provide location information of the first parts (128- 
132) to control splitting of me images of the series (100) of consecutive input images (104- 
108). 

5 An image display apparatus (400) as claimed in Claim 4, characterized in 

comprising a first memory device for storage of the location information. 
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6, An image display apparatus (400) as claimed in Claim 2 P characterized in 

comprising; 

- a motion estimation unit for estimating motion in the first parts (128-132); 

- processing means to calculate a time period during which a particular part of 
S the banner moves from a first predetermined location relative to the display device (406) to a 

second predetermined location relative to the display device; and 

- a selector to select a further one (128) of the first parts (128-132)- of a further 
input image (104), on basis of the time period. 

10 7. An image display apparatus (400) as claimed in Claim 6> characterized in 

comprising a second memory device (516) for storing the further one (128) of ihe first parts 
(128-132). 

8. An Image display apparatus (400) as claimed in Claim 1, characterized in 

IS comprising: 

- a character analyzer designed to search for textual information in the first 
parts (128-132); and 

~ a comparing unit for comparing parts of the textual information with a 
predetermined string of characters. 

20 

9- Ametbod of displaying a series (102) of consecutive output images (110-114) 

Which are based on a series (100) of consecutive input images (104-108), with the series 
(100) of consecutive input images (104-108) comprising a first image (108) and a second 
image (106), characterized in that the method comprises; 
25 - a splitting step of splitting the consecutive input images into respective first 

parts (128-132) and respective second parte (116-120); and 

- a display step of displaying a first one (1 12) of the output images (1 10-1 14) 
comprising a first block of pixels (136) corresponding to the first part (132) of the first input 
image (108) and a second block of pixels (124) corresponding to the second part (118) of the 

30 second input image (106). 



10. 



TV comprising an image display apparatus (400) according to Claim 1. 
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ABSTRACT: 



An Image display apparatus (400) for displaying a series (102) of consecutive 
output images (110-114) which are based on aseries (100) of consecutive input images (104- 
108), with the series (100) of consecutive input images (104-108) comprising a first image 
(108) and a second image (106), is arranged to split the images (104-108) of the series (100) 
5 of consecutive input images (104-108) in first parts (128-132) and second parts (1 16-120); 
and to display a first one (1 12) of the output images (110-1 14) which comprises a first block 
of^ixeisllWoorrespondmg to a first ' one (132)"of the first partsll28-i32) of the first input 
image (108) and a second block of pixels (124) corresponding to a first one (118) of the 
second parts (116-120) of the second input image (106). 
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